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REPRESENTING AND ANIMATING PAINT STROKES 

BACKGROUND OF THE INVENTION 
The present invention relates to representing and animating paint strokes. 
A paint stroke is defined in two dimensions: position and time. In the position 
dimension, the stroke is defined by a stroke path that extends from a start position to an end 
position. In the time dimension, the stroke is defined by a timing that reflects the actual time 
it takes to draw or compose the stroke. This timing will be referred to as composition time. 

The appearance of the paint stroke is defined by values for one or more stroke 
parameters. Stroke parameters can include, for example, thickness, feather, and hardness. 
The values for the stroke parameters can vary along the stroke path. For example, a stroke 
thickness parameter can have a smaller value at a first position along the stroke path and a 
larger value at a second position further along the stroke path; these values can be used to 
define a stroke that becomes thicker between the first and second positions along the stroke 
path. 

In this specification, animating a paint stroke refers to displaying the paint stroke such 
that its appearance changes over time. This effect can be produced by creating multiple 
instances of the paint stroke, each instance corresponding to a different appearance of the 
stroke, and then displaying each instance one after another in time. The timing of when each 
instance is displayed will be referred to as the animation time. 

SUMMARY OF THE INVENTION 
In general, in one aspect, the present invention provides methods and apparatus, 
including computer program products, implementing techniques for representing a stroke in 
an image, the stroke being defined by a path extending across one or more positions in the 
image and one or more stroke parameters, each stroke parameter representing an appearance 
attribute of the stroke. The techniques include associating values for the one or more stroke 
parameters with time values in a time dimension of the stroke, the parameter values being 
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associated with the time values independent of position along the stroke path; and 
representing the stroke according to the parameter values and their associated time values. 

Advantageous implementations of the invention include one or more of the following 
features. The parameter values and positions are independently associated with time values 
in the time dimension of the stroke. The association of parameter values with time values is 
defined as a function. The function is piecewise linear. A different function is used for each 
parameter. The function is implemented as a table. 

The operations further comprise changing the time value associated with a parameter 
value; and representing the stroke based in part on the parameter value and the associated 
changed time value. Representing the stroke according to the parameter values and their 
associated time values includes representing a first instance of the stroke and representing the 
stroke based in part on the parameter and the associated changed time value includes 
presenting a second instance of the stroke. The operations further comprise interpolating 
between the first and second instances to generate one or more additional instances of the 
stroke. The first instance and the second instance each correspond to a keyframe of an 
animation, the animation having an animation time frame, each keyframe corresponding to a 
time point in animation time; the time value in the time dimension of the stroke is changed as 
a function of animation time. In the first instance or the second instance of the stroke, not 
every parameter has a defined value. 

The invention can be implemented to realize one or more of the following 
advantages. Defining parameters as a function of composition time of the stroke instead of 
position makes it possible to animate parameters at a single location on the stroke. 
Independently defining each parameter as a function of time makes it possible to animate 
individual parameters separate from other parameters. The amount of space required to store 
the stroke parameters can be reduced. The processing time required to render the paint stroke 
can be reduced. The parameters of the paint stroke can be animated. The appearance of the 
paint stroke can be changed, for example, to correct aspects of the appearance without 
recreating the entire stroke. 
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The details of one or more implementations of the invention are set forth in the 
accompanying drawings and the description below. Other features and advantages of the 
invention will become apparent from the description, the drawings, and the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram of a system in accordance with the invention. 
FIG. 2 is a flow diagram of a method in accordance with the invention. 
FIG. 3 is an example of a parameter-time table for a paint stroke. 
FIG. 4 is a flow diagram of a method in accordance with the invention. 
FIG. 5 is an example of two different appearances of a paint stroke. 
FIG. 6 is an example of a user interface in accordance with the invention. 
Like reference symbols in the various drawings indicate like elements. 

DETAILED DESCRIPTION 

As shown in FIG. 1 a system 100 in accordance with the invention includes a 
composition module 1 10 for composing paint strokes and an animation module 120 for 
animating composed paint strokes. The modules 1 10, 120 can be implemented separately or 
combined into a single module. The system 100 can be a stand-alone system or a component 
within a larger system such as a video editing system. One such video editing system is 
Adobe After Effects, available from Adobe Systems of San Jose, CA. 

Composition 

The composition module 1 10 composes paint strokes and stores data representing the 
composed paint strokes for later use by the composition module 1 10 or by other modules, for 
example, the animation module 120. 

In operation, as illustrated by method 200 of FIG. 2, the composition module 110 
receives user input drawing a paint stroke (step 210). The user input can be received through 
an input device such as a keyboard, mouse or a stylus applied to a tablet. Alternatively, the 
composition module 1 10 can generate a stroke programmatically, for example, based on a 
function. 
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The composition module 110 computes position values for the stroke path and 
parameter values for the stroke parameters based on the received user input (step 220). The 
position values can be computed based on data received from the input device (e.g., 
coordinates recorded by a mouse or tablet). The parameter values can also be computed 
based on data received from the input device (e.g., stylus pressure values, stylus tilt values, 
and stylus airbrush wheel values). In computing the parameter values, the composition 
module 110 uses information received from the user that maps between data values and 
parameter values. The mapping information can specify, for example, that the stylus 
pressure values be mapped to the stroke thickness values. 

Alternatively, one or more of the parameter or position values can be computed 
without user input. For example, position values can be generated by the composition 
module 110 using an image analysis algorithm, for example, an edge tracing algorithm. The 
stroke thickness values can be computer-generated, for example, based on measuring the 
darkness values of the image. 

The composition module 110 stores the computed parameter values as a function of 
composition time (step 230). The computed parameter values can be stored as a table of 
(time, value) associations. A separate table can be used for each parameter. FIG. 3 shows an 
example of a parameter-time table 310 that stores the thickness values for a paint stroke 320. 

The composition module 110 also stores the computed position values as a function 
of composition time (step 240). The position values can be stored as distances along a 
sequence of Bezier segments and the position-time association can be stored as a table that 
maps time values to position values. The table values can represent function coefficients for 
functions that are piecewise linear. 

The position-time associations can be stored independently of the parameter-time 
associations. This arrangement enables the parameter-time associations to be changed 
independently of the position-time associations. This arrangement also allows for storage of 
paint strokes that are stationary in the position dimension, but whose appearance changes in 
the time dimension (e.g., airbrush strokes). 

The composition module 110 displays the composed paint stroke to the user (step 
240). The paint stroke can be rendered on a display device such as a computer monitor. The 
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paint stroke can be rendered as a collection of individual brush tip hits that are spaced closely 
together along the stroke path thereby creating the appearance of a continuous line. The 
rendering can involve iterating through the parameter-time tables and determining the 
parameter values at each composition time point. At a given composition time point, the 
position-time table is used to determine the location of the brush tip hit. The parameter 
values at time points intermediate to the stored time points can be generated by interpolating 
between the table entries. 

One or more of the above-described steps can occur concurrently. For example, the 
paint stroke can be displayed as the user input is received, thereby enabling the user to view 
the stroke as it is being drawn. The position and parameter values can also be computed and 
stored as the user input is received. 

Animation 

The animation module 120 takes a composed paint stroke and animates the paint 
stroke so that its appearance changes over the course of the animation. In other words, the 
appearance of the paint stroke at a first animation time point can differ from the appearance 
of the paint stroke at a second animation time point. 

In operation, as illustrated by method 400 of FIG. 4, the animation module 120 
animates a paint stroke by generating multiple instances of the paint stroke (step 410). An 
instance of the paint stroke is a version of the paint stroke at a particular point in animation 
time. The version has a value defined for at least one parameter of the stroke, but every 
parameter need not have a value defined at that time point. The value of some of the 
parameters can be determined by interpolation. 

A different instance of the paint stroke is generated by changing one or more 
composition time values associated with one or more stroke parameters as a function of 
animation time. In other words, each instance corresponds to a different point in animation 
time, and for each instance the animation module 120 changes one or more of the 
composition time values associated with one or more of the stroke parameters. 

In one implementation, the composition time values are changed by applying a 
distortion function to each composition time value. An example of one such distortion 
function is: 
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newJime=totalJime*(orig^^ 
As illustrated by this example, the distortion function takes as input the original composition 
time value along with a distortion amount and outputs a new composition time value. The 
distortion amount can be a user-specified value. The user can specify different distortion 
5 amounts to be applied at different animation time points. For example, at animation time 
point 0, the distortion amount can be 0%; at animation time point 1, the distortion amount 
can be 50%; and at animation time point 2, the distortion amount can be 100%. This results 
in an animation where, at the beginning of the animation, the paint stroke appears as 
originally composed, and then the appearance of the paint stroke becomes more and more 
10 distorted as the animation progresses. 

FIG. 5 shows an example of two stroke instances 510, 520 that can be generated 
based on applying the above-illustrated distortion function to a paint stroke 500. The paint 
stroke 500 contains six bulges, swellings distributed along the length of the stroke path. The 
relative spacing of the bulges is determined by a bulge_spacing parameter. The two 
15 instances 510, 520 are generated by using the above-illustrated distortion function to 

manipulate the composition time values associated with the bulge_spacing parameter values 
for the paint stroke 500. 

The first instance 510 of the paint stroke is the paint stroke 500 as originally drawn. 
The second instance 520 of the paint stroke 500 is the result of applying the distortion 
20 function with the distortion amount set to 100%. In the second instance 520, the spacing of 
the bulges have been distorted, causing the bulges to be crowded towards the left end of the 
stroke instead of being distributed evenly along the length of the stroke as in the first instance 
510 of the stroke. 

The animation module 120 interpolates between the first and second instances to 
25 generate one or more additional instances (step 420). The additional instances can represent 
intermediate stages of the transformation from the first instance 510 to the second instance 
520. Various forms of interpolation can be used, including, for example, linear interpolation. 
Using linear interpolation saves space and processing time because the middle entry of three 
adjacent collinear table entries can be eliminated. 
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In one implementation, the animation module 120 animates the paint stroke by adding 
the paint stroke to a movie and then creates a separate keyframe for each different instance of 
the paint stroke, each keyframe representing a particular point in animation time. 

The animation module 120 can create each keyframe based on user input provided 
through a user interface such as the user interface 600 of FIG. 6. The user interface 600 
displays a timeline 610 that represents the timing of the animation sequence. Users can 
select an animation time point 620 (or keyframe) using a slider bar or other input mechanism 
(e.g., input field, menu). At the selected animation time point 620, users can specify a paint 
stroke parameter 630, and a distortion amount 640 to be applied to the specified stroke 
parameter at the specified animation time point. For example, based on the user input shown 
in FIG. 6, the animation module 120 can create a keyframe at animation time 2 seconds that 
corresponds to the instance of the paint stroke 500 where the bulge parameter is distorted 
100% (e.g., the second instance 520 of the paint stroke 500). 

As described above, a separate function can be used for each parameter. As a 
consequence, the parameters can be changed independently at different animation time 
points. For example, for a stroke having thickness and softness parameters, the thickness 
parameter can be changed between animation time points 1 and 3 so that the thickness of the 
paint stroke increases between time point 1 and 3. The softness parameter can also be 
changed, but between animation time points 2 and 4. In this example, the keyframe 
corresponding to the instance of the paint stroke at animation time point 3 would have a 
value defined for the thickness parameter, but the value for the softness parameter would not 
be defined by the keyframe; instead, it would be calculated by interpolating between the 
softness values defined at keyframes for animation time points 2 and 4. 

The invention can be implemented in digital electronic circuitry, or in computer 
hardware, firmware, software, or in combinations of them. Apparatus of the invention can be 
implemented in a computer program product tangibly embodied in a machine-readable 
storage device for execution by a programmable processor; and method steps of the invention 
can be performed by a programmable processor executing a program of instructions to 
perform functions of the invention by operating on input data and generating output. The 
invention can be implemented advantageously in one or more computer programs that are 
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executable on a programmable system including at least one programmable processor 
coupled to receive data and instructions from, and to transmit data and instructions to, a data 
storage system, at least one input device, and at least one output device. Each computer 
program can be implemented in a high-level procedural or object-oriented programming 
language, or in assembly or machine language if desired; and in any case, the language can 
be a compiled or interpreted language. Suitable processors include, by way of example, both 
general and special purpose microprocessors. Generally, a processor will receive instructions 
and data from a read-only memory and/or a random access memory. The essential elements 
of a computer are a processor for executing instructions and a memory. Generally, a 
computer will include one or more mass storage devices for storing data files; such devices 
include magnetic disks, such as internal hard disks and removable disks; magneto-optical 
disks; and optical disks. Storage devices suitable for tangibly embodying computer program 
instructions and data include all forms of non-volatile memory, including by way of example 
semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; 
magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and 
CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs 
(application-specific integrated circuits). 

To provide for interaction with a user, the invention can be implemented on a 
computer system having a display device such as a monitor or LCD screen for displaying 
information to the user and a keyboard and a pointing device such as a mouse or a trackball 
by which the user can provide input to the computer system. The computer system can be 
programmed to provide a graphical user interface through which computer programs interact 
with users. 

The invention has been described in terms of particular embodiments. Other 
embodiments are within the scope of the following claims. For example, steps of the 
invention can be performed in a different order and still achieve desirable results. What is 
claimed is: 
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